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The purpose of this study was to Investigate the effect of using 
mult idimengional items in a computer adaptive tast (CAT) setting which /issumcs 
a unidimcnsional IRT framework* Previous research has suggested that the 
composite oi multidimensional abilities being estimated by a unitiimensional 
IRT model is not constant throughout the entire unidimon^ionat ability scale 
(Reckase, Carlson, Aekfetman, h Spray, 1986)- Results of this study suggest 
chat univariate calibration of multidimensional data tends to "filter" out the 
multidimensional ity. The closer an Item's multidimensional composite aligns 
itself with the calibrated univariate ability scale**! orientation, thu larger 
the estimated discrimination parameter. If CAT item seLecti^n is based upon the 
amount of information an item provides, items requiring similar (8^ e a ) composites 
will most often be selected* 

These results further imply that in a CAT different abilities throughout 
the 8j» 8 2 plane could receive §eto of items that liseriminate between 0 l and Q 2 to 
different degrees* Also* different: abilities aloni* the mapped univariate scale, 
could receive tests having different proportions of iEem content. 
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The Uso of tridimensional Item Parameter Estimates 
of Multidimensional Items in Adaptive Testing 

Most item response theory models assume that an examinee f s teat 
performance can be explained by a single ability or latent trait* That is, an 
examinee's position in the latent ability spaa© can be determined by measuring 
a single ability dimension* However, one suspect that this assumption 

is rarely met because there are many cognitive factors that may account for an 
individual's response to an item (Traub, 1983). ror a group of individuals, 
it is doubtful that a single cognitive skill, or constant combination of 
skills, would be used by each person to respond to a single item* It is even 
more highly suspect that this assumption of unidimensionaiity would be mot for 
a group of individuals responding to an entire test* 

Reekase, Carlson, Ackerman, 4 Spray (1986) have shown that for generated 
two dimensional data, where difficulty and dimensionality of the items are 
confounded (e.g., easy items measure only ability 1 and difficult items 
measure only ability 2), the unidimen s ional abi I i ty est imat ion scale is 
related to different composites of the two abilities at different points on 
the unidimensional ability scale. Specifically, they reported that for the 
particular confounding of ability and difficulty used, the examinees in upper 
LOGIST estimated ability deciles differed mainly on 8 2 while those in the 
lower deciles differed mainly on 8., 

If these results are generalizable to real achievement te*it items, it 
could have a profound effect on the application of computer adaptive testing 
(CAT). If an adaptive test item pool is composed of items which require 
different composites of ability to answer correctly, low ability and high 
ability individuals may be administered two sets of items that measure 
completely different combinations of skill. 
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The unidi - facceriatics are thought to be a function of the 

alignment of l> n the multidimensional ability space. This 

alignment or tangly influenced by the pattern of the 

multidimensi •« nation over the B lf o 2 plane. That is, if more 

information ^crimination) is provided along the Q i axis, calibration 

using a univa aodsl would orient the univariate ability scale along 

the 0 | axis* * 'Utaset provided uniform information throughout the ability 

plana, both dimensions should be represented equally well and the univariate 
scale should be mapped at a 45 9 angle between the B lf G a axes. However, if the 
individual items differed in the composite of abilities needed for a correct 
response., tests composed of different items could have different orientations in 
the 8 lf 8 2 plane. How the calibrated univariate scale is positioned in the plane 
may affect how different locations in the plane are mapped onto the scale. 

Samejima (1978) has suggested that univariate tests are truly parallel if 
they provide the same amount of information on each point throughout the 
ability scale* The logical multidimensional extension would be that two tests 
are parallel if the composite of abilitiei required for a correct response is 
the same for all points in the ability space, The primary focus of this study 
was to examine the concerns of Reckase and colleagues that persons at 
different locations along the theta stale would not receive parallel tests or 
items having the same ability composites, 

Three hypotheses were examined in this study. First f it was believed 
that the orientation of the univariate theta scale in the two dimensional 
ability plane would differ as the composite of items in the test changed, A 
second part o£ this study was to briefly examine how the B %f B 2 plana was 
mapped onto the univariate scale* It was suspected that differences in test 
administration format could change the way in which 8 Jf e f combinations are 



Adaptive Testing 
5 

mapped onto the univariate scale. Third, based upon the findings of previous 
research by Reekase, et al. (i9S6) it was hypothesised that individuals with 
different ability levels on the mapped univariate ability scale would receive 
items from a CAT that would require different 0 lf 8 2 combinations for a 
correct response. 

To verify these hypotheses, two experiments were conducted. The first 
experiment examined the hypotheses with generated data* while the second used real 
data in which difficulty was known to be confounded with dimensionality. To confirm 
the first two hypotheses two different test formats were used in each experiment. 
The first was an adaptive test format (CAT)| the second was an administration of 
the entire item pool (CPA)* For both CPA formats, two simulations were 
conducted f one to establish the univariate seal* orientation in the 8^ 8 2 plane, 
and one to study the mapping of the e Jf B a plane onto the univariate scale. To 
verify the third hypothesis a third simulation for the CAT format only was 
conducted to determine if abilities along the mapped univariate scale received 
tests composed of different items* 

Experiment 1 

Method 

Generation of Item Response Data 

Using a two dimensional IRT model, a test item pool of 100 items was created 
with multidimensional item discrimination, MDISC values (See Reckase, 1986) 
randomly selected from a beta distribution (a ■ ,11, 0 » The 
multidimensional diflieulty parameters were randomly selected from a 
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uniform U(0 f 1) distribution* By selecting item parameters in this manner, 
multidimensional information (Reekase, 1986) remained relatively constant 
throughout the ability plane. The multidimensional information is shown in 
the plot of the test information given in Figure 1, Vectors at 10 degree 
Increments for 49 selected points are presented* The length of each vector 
represents the height of the multidimensional test information surface at 
the <8 lf e 2 ) point in the direction of the selected angle, The length of 
the vectors are about equal at each angle at each point, indicating uniform 
information. 

Insert Figure I about here 

A plot of the item vectors is shown in Figure 2 a Each item vector 
represents the distance and direction from the origin to the point of maximum 
discrimination for a given item, To achieve uniform information, the majority 
of items had to measure predominantly either 8 l or 8 2 This is shown in 
Figure 2. The majority of item vectors are either positioned close to 
the 8j or close to the B 2 axis. 

Insert Figure 2 about here 
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In the first simulation, 2,000 (Q {f 0^) combinations were randomly 
selected from a bivariate normal distribution, N (0, ][) where £ was the 
identity matrix, to simulate response vectors to the set of 100 selected item 
parameters using the compensatory multidimensional item response theory model 
(see Reckase, 1985) . In this modal the probability of a correct response to 
item i by person j is given asi 



a, B . * d, 
— i i 

PCX, . « l|a. f d f 0.) - - (i) 

1 * e" 1 ~ J 1 



where Xjj is the response to item i by person j, 

a^ is a vector of item discrimination parameters, 

d^ is an item parameter related to the difficulty of an item, and 

J|, is a vector of person parameters* 



Procedure 



The generated response vectors were calibrated to a unidimensional two- 
parameter IRT model using LOGIST (Wingersky, Barton, h Lord, 1982), Using 
these item parameter estimates, the two test formats (CAT and CPA) were 
simulated for 1000 (8^ e 2 ) ability combinations from the N(0, |) distribution 
mentioned previously. The purpose of selecting these two testing formats was 
to determine how each format mapped the univariate scale onto the two 
dimensional ability plane* 

In the CAT simulation, the initial unidimensional estimate of ability was 
0,0* Items were then selected using their unidimensional parameter 
estimates* Once an item was selected, the probability of a correct response 
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was computed using the known two-dimensional item parameters and the 
preselected (0 l# 9 2 ) ability in the compensatory model presented above. This 
probability was then compared to a randomly generated threshold value from a 
U(0, 1) distribution to yield a correct or incorrect response* The 
unldimensional ability estimate wa«* then updated* This iterative CAT process 
was carried out until either 20 items were administered or the selected item 
had an information value £or the current 8 of less than *3. The CPA process 
was identical to the CAT simulation; however, the minimum information cutoff 
was set to 0*0 and the maximum test length was set to 100 items, 

The calibrated 0's were then rank ordered and divided into 20 
quantiies* For each quantile, the Q l9 I | centroids were calculated. Since 
the centroids appear to be described by a line, a least squares regression was 
used to provide a linear approximation to the univariate ability scale 
orientation in the two-dimensional plane, By comparing the scale orientation 
for each test format the first hypothesis could be evaluated* 

Once the orientation of the univariate scale was established, the two 
types of testing formats were again simulated 100 times each for 37 selected 
points throughout the 8^, B 2 plant. The 37 points (Figure 3} were selected to 
cover the region with greatest density for the bivariate normal 
distribution, N<0* ][). 

Insert Figure 3 about here 



,, Migration l, vectors were then plotted to examine the second hypothesis, 
these vectors illustrate how the selected (8 19 8 2 ) points was mapped onto the 
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newly oriented univariate ability scale. The mapping of the two dimensional 
plane onto the univariate scale was then evaluated* 

To evaluate how points from the two-dimensional ability plane are mapped 
onto the univariate scale it is necessary to examine the response surface of 
the compensatory MIRT model. In Figure 4 ? the contour plots showing lines of 
equiprobability for a correct response for three equally discriminating items 
are shown* Three selected abilities, A(2, 0), B<0, 0), and CCD, 2) are 
plotted on each contour* 

Item 1, shown in Figure 4a, discriminates or provides information only 
along 8 2 * If a test was composed of items identical to Item 1, points B and C 
would receive the same ability estimate} however, it would be than A, 

Item 2, displayed in Figure 4b, provides information only along 8^ In a 
test composed of items of this type, points A and B would receive the same 
ability estimate, although Point C would have a higher estimated ability, 

Item 3, plotted in Figure 4c, represents an item that discriminates 
equally well on both 6 t and 8 a * Points A and C would be estimated to have the 
same ability, by a test having items which also discriminate equally well on 
both dimensions* On such a test, Point 8 would be estimated to have a lower 
ability than both A and C. 

Thus, by examining points on the 8 lf 8 2 plane in relationship to other 
points which have the same 8 lf same B 2 or opposite (8^ 8 2 ) coordinates (i,e* 
(0, 3) and (3, 0) which lie on a diagonal) the degree to which each dimension 
is being measured can be determined. 

Insert Figures 4a, b, and c about here 
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A final simulation was uged to examine the third hypothesis. 
Seven (0,, 8 Z ) ordered pairs representing the uni dimensional abilities -3, -2, 
-1, 0, 1, 2, and 3 on the mapped univariate scale were computed, A CAT was 
simulated 100 times for each of these (fl lf e 2 ) combinations to observe if the 
composite of items administered at each selected ability level measured each 
dimension to the same degree. 



Resul t a 



The centroid plots for the 20 quantiles for both test formats are shown 
in Figure 5. A line of best fit, representing the orientation of the 
univariate scale in the 8,, 8 2 plane was obtained using a least squares 
regression procedure. The orientation equations are Y - ,81X - ,03 for the 
CPA and Y • «25X - .03 for the CAT. 



Insert Figure 5 about here 



Migration plots, illustrating where on each test format's orientation line 
the selected (e It 8 2 ) abilities were mapped, are shown in Figures 6a and 6b. 
Several interesting comparisons can be made by examining these two plots. First 
the CPA ability orientation has an estimated slope that Is more steep than the 
CAT orientation line. This would imply that those items which discriminate 
better along 8j have larger calibrated univariate discrimination parameters and 
would be more likely to be selected in a CAT administration. Thus it was 
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assumed that LOCI ST "oriented 11 the univariate scale cloiier to the Q { axis* 
This was confirmed by computing r* and r* which were .68 and -%50 f 
reBpOdtively. 



Insert Figuree 6a and 6b about here 



A second notable feature is that the CAT migration "vectors" appear to 
contract the ability scale whereas the complete administration (CPA) migration 
vector seem to expand the scale, Using the CPA format the points (3, 0) and 
(0, 3) are mapped onto the univariate scale in roughly the same place 
suggesting that the items administered at these points collectively measure 
both dimensions equally well. The same is true for the points (=3, 0) and 
(0, *3). However, in the CAT administration points (0, 3) and (0, 0) are 
mapped near the same univariate ability, suggesting more information in the 
items being presented at these points, is provided along 0 l# The same 
information structure occurs in the items administered at the points (0, 3) 
and (0, 0). 

A final plot of the test information vectors was drawn for those items 
that were administered at the seven selected ability values along the 
mapped 0 scale. The purpose of this plot was to see if the amount of 
multidimensional information was uniform throughout selected points, cr if 
lower/higher abilities received more/less informative items along one 
dimension than the other* The resulting information vectors, plotted in 
Figure 7, also suggest that the univariate abilities received items which 
discriminate better along S l for most of the selected abilities. In the 
range *3 < 8 < 1, 9^ is noticeably being measured with more accuracy. 
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Insert Figure 7 about here 



Discussion 

Several areas of caution or concern arq suggested by these results* Eve 
though an item pool whan considered collectively, provides approximately the 
same amount of information in each direction for all points on 
the 8j, B 2 plane it does not guarantee that smaller subsets will also provide 
the same amount of uniform information. The orientation of the univariate 
ability scale appears to be a function of the informational structure of the 
items. 

Secondly f the LOCIST calibration process tends to emphasise only some of 
the dimensions that may occur in the test items, Depending on how its scale 
is oriented in the two dimensional plane, discrimination estimates for 
specific items are greater or smaller, The closer the LOOIST ability scale ii 
oriented to the item vector, the higher the discrimination parameter estimate 
for the item. Items with vectors that are essentially orthogonal to the line 
of orientation will have very small discrimination parameter estimates, 

Thus the calibration orientation ultimately would determine which items 
will have the higher discriminations and thus be chosen more often for 
unidimensional CAT* While this process should suggest that items selected at 
the various abilities above the univariate scale should not vary too much in 
dimensionality, this was not thm case. In the CAT simulation at the seven 
selected abilities (Figure 7), more information was provided along Q x for 
-2 < 0 < 3. At points not on the mapped univariate scale (3, 0), (0, 3), 
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(>3, 0), and (Q, -3) administered items also provided more Information 
along Oj, Thus, it appears that deapita using an item pool that coLUetlvciiy 
provided uniform information, different points in the ability plane did not 
receive what Samejima (1977) terms parallel tests. 

Experiment 2 

In the second part of this study, a paraiisl analysis was conducted using 
simulated data based on the characteristics of an actual item pool* 

Method 

Item Response Generation 

The item pool used in the second part of this study was created from the 
ACT Assessment Math Usage test Form 26A. The test contained 40 multiple 
choice items covering sim content areas (See Appendix A for a brief 
description of the content areas). Using 3,000 subject's responses from an 
ACT test administration, two-dimensional item parameters were estimated using 
the compensatory multidimensional IRT program MIRTE (Carlson, 1987). MIRTE 
was used to calibrate the response data using the two-dimensional IRT model 
given in equation 1. The calibrated multidimensional item parameters (a*, a 2 , 
and d) were then used to expand the 40 item set so that the six content areas 
each contained 16 l^ems. For example, the eight geometry items in the 
original 40 item set were each repeated twice to produce 16 items in all. The 
purpose of expanding the dataset was twofold: to increase the si^e of the CAT 
pool and to assure that each content area had the same number of items in the 
pool. 

14 
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Three thousand paim o£(8 lf 0 7 ) wern th«n r/t* lomly elected from the 
bivariate normal distribution described previously. Hyaponses for the 96-item 
set were then generated using the multidimensional item pfirametor estimates in 
thes M2PL model* This was necessary to preserve the mult idimensionnli ty of the 
it^ma* The simulated response data were then calibrated using LOGIST to 
obtain unidimenaienal item parameter estimates* 

Procedure 

Again two different test formats were simulated* The first teat involved 
the complete administration (CPA) of the entire 96-item pool. The second test 
was a simulated adaptive test (CAT) which followed the same procedure aa in 
Experiment' \ . 

Each test wns simulated for 1,000 subjects randomly drawn from a 
bivari^e normal N{0* J) distribution to obtain the orientation of the 
estimated ability scale in the B l$ B 2 ability plane* 

To determine how the multidimensional ability scale would map onto this 
orientation line, each test was simulated 100 times at 37 ability points 
(Figure 3) selected to represent this bivariate normal distribution. A final 
simulation was conducted 100 times for each of the points on the mapped 
univariate scale representing the abilities from -3 to +3 in increments of 
1*0. 

Besides the migration plots for each type of test and the test 
information plot at selected univariate abilities, the content of items 
selected at each ability level was examined to see if different abilities 
received a different composition of items in the CAT simulation* 
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Rgaul tn 

A plot of the multidimensional IRT test information function for the 96 
item pool id shown in Figure 8. Unlike the generated data gat which had 
uniform information* the expanded Form 26A item pool provided the moat 
information in a band where Theta 2 * 0*0 and Theta 1 spanned the range from 
*3 to +3* The greatest amount of information in this band is concentrated 
more along the second ability dimension* Very tittle information in provided 
where both abilities were very high or very low, To further explore this 
issue* plots of the test information functions for each of the six content 
areas were examined for differences* These plots are shown in Figures 9a*-f* 



Insert Figure 8, 9a-f about here 



The multidimensional information plots for the Geometry (G) f the Number 
and Numeration Systems (NN3) P the Intermediate Algebra (IA) and the Algebraic 
and Arithmetic Operations (AAO) items ail have larger information vectors 
along the second ability dimension, albeit at different places in 
the 8 lf 8 a ability plane* The Arithmetic and Algebraic Reasoning ( AAR) items 
are more discriminating along the first ability dimension* 

Upon examining the content of these item types, it becomes clear that the 
first dimension might correspond to a verbal reasoning ability because all of 
the AAR items are "story" or word problems* The other content areas, IA f G, 
NNS f and AAO all involve some form of numerical computation. This hypothesis 
was confirmed by examining the advanced topic (AT) information plot* On the 
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original 40 item teat there were only two AT items* One of the items was a 
story problem, the other an algebraic manipulation problem. The information 
vectors for AT tend to measure best aiom Q 2 for the horizontal hand and best 
along Oj in the vortical band* It ia believed that the horizontal band 
illustrates the information provided by the numerical computation items and 
the vertical band the information provided by the verbal reasoning item* 

To verify that the variety of multidimensional test information surfaces 
for the Bin contents would have equally dissimilar univariate teat information 
functions, the test information plot using the LOGIST item parameter estimates 
for each content area and the total test is shown in Figure 10* 

Insert Figure 10 about here 

The AAO content area provided the most overall information, while NNS provided 
the least* The siic univariate teat information functions provided a striking 
contrast to their multidimensional counterparts. Compared to the wide 
variation portrayed in Figure 6 f the univariate plots show a higher degree of 
similarity, 

The plots of the centroids for the CAT and CPA administrations are ahown 
in Figure 11. The curvature of the centroids, suggests a confounding of 
difficulty and dimensionality, Bach test's centroids were fit using a 
hyperbolic function! 

8 t * ~t — r~q" fQr the CAT centroids. 
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,3 * 2*50 t 



and 0 2 * ~ for the CPA centrotdo. 



Insert Figure 11 about: here 



the migration plots, showing how the two different test administration 
formats mapped the seleeted points onto the orientation curve, are illustrated 
in Figure 12a and b* Although the orientation of the univariate scale is more 
curved for the CAT, the mapping of the 37 selected abilities appears to be 
somewhat similar. The contraction/expansion difference between the CAT and 
CPA mappings that existed with the generated item pool in EKperiment 1 does 
not appear. Most of the abilities are mapped orthogonally onto the univariate 
ability scale. 

In the CPA, the ability points (3, 0) and (0, 3) are mapped into about 
the same univariate ability. This is also the ease for the points (-3, 0) and 
(0 *3>, This would suggest that these four points receive items in CPA, which 
collectively discriminate $ x and § 2 equally well. 

In the CAT, abilities («3, 0) and (0, -3) are mapped close to the same 
univariate ability. However, the points (0, 0) and 0, 3) are mapped closer to 
each other than (3, 0) and (0, 3), This would indicate that points in the 
first quadrant receive items that discriminate better along 8^, while the rest 
of the points receive items which discriminate equally well between both 
dimensions* 
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Insert Figures 12a and b about hero 



The CAT information function for the seven selected ability points along 
the mapped univariate scale is shown in Figure 13* Unlike the results of 
Experiment 1, items selected at each aoiiity level appear to be measuring the 
two ability dimensions equally well* 



Insert Figure 13 about here 



The results of the content composition at the seven abilities were also 
computed* Table 1 demonstrates tha shift in item content for each of the 
ability levels* No MNS items were selected at any of the seven ability 
values. This may be the result of their low univariate discrimination values 
which is partly due to the LOCI ST scale orientation in the 9 lf 6 2 plane, This 
is further verified by the univariate test information plot (Figure 10) which 
shows the NNS items as being least discriminating, Only the IA items appear 
to be represented in about the same percentage across the 9 scale. Fifty 
percent of the items administered it 8 s -3*0 were AAO items, while 
at 8 ■ 3*0 only 16% items were AAO* Ho AT items were administered below 

ft 

a 8 value of 0,0, yet over a fourth of the items administered at 8 - 3,0 were 
AT. 
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Insert Table 1 about here 

A check to gee if the use of the multidimensional item parameters 
affected the estimates in any way was conducted, A second CAT admini strat io 
was simulated at the same ability points using only the univariate item 
parameter estimates to calculate the probability of a correct response. 
The difference in item content ig even more pronounced, At 8 " -3.0, 88% of 
the items administered were IA items. At 8 - 3.0, 89% of the Items 
administered were AT items* Again no NNS items were selected* 



Insert Table 2 about here 



General Discuss ion 

The results of this study would strongly suggest that the concerns over 
different abilities receiving different content in adaptive testing are 
valid. In Experiment 2, the multidimensional item vectors computed at the 
seven selected 8 points along the mapped univariate scale appeared to be 
measuring equal composites of Bj and & 2 (Figure 13), However, the percentage 
of the six content areas administered throughout the univariate ability scale 
did differ noticeably. It would be interesting to see how dramatic the shift 
in 8 would be if the CAT was admini sttirad in such a way as to control the 
number of items from each content area, Because each GAT test may differ in 
length, the problem would not easily be solved. 
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The orientation of the univariate ability scale in the two-dimensional 
ability plane appearo to be a function of multidimensional composition of the 
items administered in a test, The item selection process of a CAT 
administration tendJ to make the univariate scale orientation similar to that 
obtained for a univariate calibration. This occurs because items which 
have 8j f 6^ composites closer to the univariate calibration orientation will 
have higher estimated discrimination values* 

Multidimensional information vector plots appear to hm quite helpful in 
revealing suspected differences between different content areas * While 
unidimensional information functions may display a high degree of similarity, 
multidimensional information plots could be used to help identify the 
necessary component skills required to answer various item types. Such 
information could become an important ingredient in the test development 
process. 

This study also graphically illustrated how different two-dimensional 
abilities are mapped onto a univariate scale which is oriented in 
the e lf 0^ ability plane. For both generated data and the quasi-real data 
there appeared to be differences in the degre to which each ability dimension 
was measured for different points in the B lf 6 2 there plane. That is, 
strictly parallel tests would not be administered at all (e lf B^) points in 
the ability plane for either data set. Perhaps this could only occur for a 
truly unidimensional item pool. 

This study suggests that more work needs to be conducted to understand 
the purifying process that use of unidimensional calibration of 
multidimensional data has on the ability estimates obtained from a CAT 
administration. The richness of different item contents may have to be 
filtered out to meet the model requirements of univariate CAT* 
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Figure Captjona 



FjjureJ.. Multidimensional cast information vectors for the generated item 
parameters at 10 degree increments at selected points in the 8-space. 
Figure 2. Vectors for the generated item parameters representing the 
direction and distance to the point of maximum discrimination. 
gi S Ure 3 * Points in the two-dimensional ability space used to cover the 
greatest density of the selected blvarlate normal distribution. 
£iSure_4. Contour plots of three compensatory items which differentiate 
along B 2 only (4a), along 0, only (4b), and equally on 8, and 9 2 (4c). 
Fi B ufe 5 ' ^ centreids of the observations for the 20 quantiles for the 
simulated CAT and CPA test administrations using generated two-dimensional 
item parameters. 

Figure 6m t b. Vectors illustrating the mapping of selected points in the two- 
dimensional ability apace onto the mapped univariate ability scale for the 
simulated CPA (6a) and CAT (6b) test administrations. 
|ifiure_7. Multidimensional test information vectors of the generated 
parameters for the items administered in the CAT at seven selected abilities 
along the mapped univariate ability scale. 

Fi 8" re 8 ' Multidimensional test information vectors for item parameters from 
the expanded Form 26A at 20 degree increments at selected points In 
the 9-space. 

Figure 9a-f. Multidimensional test information vectors for each of the six 
content area at selected points in the 9-space. 

Figure 10. Unldimensional test information functions for the total pool and 
each content area using the calibrated item parameters. 
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Figure Captions (cant.) 

Figure 11 , The eentrolds o£ the observations for 20 quantiles for the 
simulated CAT and CPA test administrations used the item parameters from the 
expanded Form 28A, 

Figures 12a» b , Vectors illustrating the mapping of selected points in the 
two-dimensional ability space onto the mapped univariate ability scale for the 
simulated CPA (12a) and CAT (12b) test administrations* 

Figure 13 * Multidimensional test information vectors of the parameters for 
the items from Form 26A administered in the GAT at seven selected abilities 
along the mapped univariate ability scale. 
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FIGURE 4a 
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FIGURE 5 
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FIGURE fia 
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FIGURE 10 
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Appendix A 



ACT M4THEMATICS USAGE TEST 

Del cHption of the test. The Mathematics Usage Test is a 4(Ntem 4 50-minutc test that measures the student*;* 
mathematical reasoning ability, It emphasizes the solution of practical quantitative problems that are 
encountered in many postsecondary curricula arid includes a sampling of mathematical techniques covered in 
high school courses. The test emphasizes quantitative reasoning, rather than memorisation of formulas* 
knowledge of techniques, or computational skill* Each item in the test poses a question with five alternative 
answers, the last of which may be "None of the above " 

Content of the test. In general, the mathematical skills required for the test involve proficiencies emphasised in 
high school plane geometry and first* and second-year algebra, Six types of content are included in the test, 
These categories and the approximate proportion of the test devoted to each are given below. 



Mathematics Content Area Proportion of Test Number of Items 

a. Arithmetic and Algebraic Operations ,10 4 

b* Arithmetic and Algebraic Reasoning .35 14 

c* Geometry ,20 S 

d, Intermediate Algebra ,20 8 

e, Number and Numeration Concepts ,10 4 

f, Advanced Topics ,05 2 



Total 1,00 40 



a, Arithmetic and Algebraic Operations, The items in this category explicitly describe operations to be 
performed by the student. The operations include manipulating and simplifying expressions containing 
arithmetic or algebraic fractions, performing basic operations in polynomials, solving linear equations in one 
unknown, and performing operations on signed numbers, 

b* Arithmetic and Algebraic Reasoning, These word problems present practical situations in which algebraic 
and/ or arithmetic reasoning is required. The problems require the student to interpret the question and either 
to solve the problem or to And an approach to its solution, 

a Geometry* The items in this category cover such topics as measurement of lines and plane surfaces* properties 
of polygons, the Pythagorean theorem, and relationships involving circles. Both formal and applied problems 
are included, 

d, Intermediate Algebra, The items in this category cover such topics as dependence and variation of quantities 
related by specific formulas, arithmetic and geometric series, simultaneous equations, inequalities, exponents, 
radicals, graphs of equations, and quadratic equations. 

e, Number and Numeration Concepts, The items in this category cover such topics as rational and irrational 
numbers, set properties and operations, scientific notation, prime and composite numbers, numeration 
systems with bases other than 10, and absolute value, 

f, Advanced Topics, The items in this category cover such topics as trigonometric functions, permutations and 
combinations, probability, statistics, and logic. Only simple applications of the skills implied by these topics 
are tested. 
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